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1 . Motivation 


A thorough  understanding  of  analog-to-digital  coding  is  a first  step 
toward  a new  theory  of  digital  control  (OJ . As  opposed  to  present  theories 
which  assume  continuous  control  levels,  a new  theory  of  direct  finite- 
level  digital  control  may  lead  to  more  efficient  implementations  and 
better  performance.  Unfortunately,  the  mathematics  of  conversion  of 
coding  continuous  waveforms  into  finite-level  waveforms  (acceptable  to 
computers)  is  not  well  understood. 

Consider  a typical  feedback  situation  illustrated  in  Figure  1,  where 
a continuous  plant  is  controlled  by  a digital  computer.  Because  the  con- 
tinuous waveform  from  the  plant  must  be  converted  to  digital,  a coder  is 
necessary,  and  a decoder  for  digital-to-analogy  conversion. 

Ultimately  we  want  to  understand  the  interaction  of  continuous  and 
digital  feedback,  since  new  insights  may  be  gained  in  the  design  of 
digital  controllers.  For  example,  it  has  been  shown  [1]  that  a first- 
order  linear  system  can  be  stabilized  by  a digital  system  as  simple  as  a 
flip-flop.  Obviously  this  implementation  is  much  less  costly  than  a 
sampled-data  system  with  a digital  multiplier,  which  would  be  assumed 
in  present  theories  of  feedback  control. 

But  before  systematic  design  procedures  can  be  found,  we  must 
throughly  understand  the  interaction  of  digital  machines  with  continuous 
plants  through  the  coding  and  decoding  processes. 


: 
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As  a preliminary  mathematical  model  we  can  assume  each  element  on 
the  feedback  loop  can  be  represented  as  a functional  mapping  from  the 
set  of  all  possible  input  waveforms  to  the  set  of  all  output  waveforms. 

In  particular  we  are,  therefore,  studying  a very  general  coder,  one  that 
might  have  memory  and  whose  output  might  reflect  very  complex  properties 
of  the  continuous  input  waveform. 

For  a meaningful  theory  the  class  of  input  and  output  waveforms  and 
the  kind  of  functionals  between  them  must  be  restricted  to  reflect  the 
properties  of  physical  elements  themselves.  When  such  restrictions,  or 
properties  are  given  to  the  systems  and  spaces  being  studied,  the  complex 
systems  can  often  be  decomposed  into  simpler  units  and  this  new  understand- 
ing results  in  simplified  design  procedures  and  stronger  statements  about 
the  limitations  of  such  systems.  In  the  cases  of  continuous  plants  and 
computer  controllers,  these  simplifications  have  been  made  and  are  very 
useful  (Continuous  system,  12]  and  [3];  digital  [4]).  Less  is  known 
about  asynchronous  computer  controllers  [5] . But  there  is  little  known 
about  general  coding  functionals. 


T 


J 


2 . Problem  Statement 


Let  V O PC (R;  Rn)  (that  is,  V is  subset  of  all  piecewise  continuous 

functions  from  R to  Rn) , and  let  R C1pc(R;  X)  where  x is  a finite  set.  The 
functional 

S:  V R 

is  a coder . S is  causal  if 

Vl  = PTf2  Sfi  = Sf 2 

where  f ,f2  e V and  PTf  = ( f t < T 

| 0 0 > T 

Of  course  many  of  the  coding  functionals  which  meet  the  above  requirements 
do  not  correspond  to  the  physical  behavior  of  any  real  device.  This 
suggests  two  problems:  first,  what  property  can  be  formulated  which 
captures  the  implementable  of  a coders;  second,  can  this  property 
(perhaps  strengthened)  be  shown  to  imply  a canonical  structure  of  such 
coding  devices.  Such  a decomposition  might  involve  a continuous  linear 
part,  a non-linear  memoryless  threshold,  and  a nonlinear  digital  part. 


Summary  of  Present  Work 


We  begin  with  an  example  to  illustrate  the  difficulties  in  formulat- 


ing a plausible  realizability  criterion. 


3.1  Defn. 
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Let  0Q:  R {0,l}  be  defined  by 


e0(t) 


1° 
I 1 


t < 0 
t > 1 


Let  S„  : PC  (R,  R)  RC(R+,{0,l})  be  the  elementary  O-threshold  coder 


°0 

defined  by 


s90'f>  * VE 


SA  is  a memory less  coder  and  very  simple  to  implement,  so  any  reason- 

0O 

able  class  of  mathematically-defined  coders  must  include  it.  Obviously 
linearity  cannot  be  assumed;  also,  the  O-threshold  coder  is  discontinuous  in 
the  usual  sense.  This  is  illustrated  in  the  following  example;  a few 
preliminary  definitions  will  be  given  for  completeness. 

3.2  Defn.  Let  Y be  a set  and  let  d be  a metric  on  Y . We  write 

1 im  f . = f 

d 1 

R R 

for  a sequence  f . e Y and  fcY  iff  for  any  T > 0 and  any  e >0  there  is 
an  NCZ+  such  that 


d(P  f.,  P f)  < e 
T 1 T 


when  i > N. 


3.3  Defn.  A coder  S:  PC(R  ,R)  -*•  PC(R,X)  is  d1d2  continuous  iff 


lim  f . = f 

dl 


(fi  e PC (R  , R) ) 


n 
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A similar  series  could  be  defined  on  the  binary  output  as  the  series 
of  transition  times,  either  1 to  0 or  C to  1;  obviously  this  series 
would  be  the  same  as  f*(0)  and  we  could  write 


(s0  f2) 
0 


f2(°)  **  (°» 


Letting  f^(0)k  be  the  kth  element  in  the  series,  define 


U) 

P2(f.q)  = }'  |f+(0)k  - g+(0)k| 


booking  at  the  transition  times 


f>  - <0'  171'  St'-) 

we  see  they  will  converge  under  p to  sin+(0)  = (0,  it,  2it,...) 


lim  f.  = sin  t 
P 1 

and  since  (S0  f.)  = 

0 1 


f*(0), 


lim  S„  f. 

i 

P o 


S-  1 im  f . 
°0 


which  shows  a limited  kind  of  continuity  of  transition  times  in  this 
particular  case. 


There  are  two  problems  in  making  this  idea  rigorous.  First,  we  must 
be  sure  that  the  functions  under  question  have  well  defined  transition 
sequences,  not  infinitely  many  transitions  in  a short  period.  Second, 


we  must  define  a more  general  metric  P so  that  a reasonable  class  of  thresholds 

are  continuous  . Sequences  like  the  one  illustrated  in  Example  3.4  should  be 
divergent . 

3 . 6 Example 

Let  f(t)  = 0 t <_  ° 

- 1 

e x sm  — t > 0 
x 

00 

It  can  be  shown  that  f is  C . Yet  there  is  no  first  zero-crossing  for 
t •»  0. 

tJO 

Thus  C is  still  too  large  a class  of  functions  to  meet  our  require- 
ments. We  now  introduce  a class  F of  normal  functions  from  R+  to  a 

R ,Y 

set  Y,  which  have  well  defined  transition  times,  closure  under  composition, 
and  lead  naturally  to  a notion  of  continuity  which  includes  all  thresholds. 
Normality  Spaces 

We  will  first  define  a class  of  normal  sets  on  a space  X in  analogy 
to  a class  of  open  sets  in  a topology.  The  idea  is  to  then  let  f:  x y 
bo  a normal  set  if  the  inverse  image  of  a normal  set  is  normal,  again  in 
analogy  to  continuity.  Given  a few  additional  properties,  and  by  choosing 
our  class  of  normal  sets  properly,  we  will  show  a class  of  normal  functions 
are  closed  under  com{»sition  and  have  well-defined  transition  times. 


3.7  Defn. 


A triple  (X,  p^,  N^)  is  a normality  space  if 
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i)  P is  a metric  on  X 

x 

ii)  N is  a subset  of  the  Borel  sets  generated  by  p .called  the  set  of 

x x* 

normal  sets 

iii)  If  A, B t N then 
x 

a)  A is  bounded 

b)  A B,  A - B t N 

x 

iv)  Every  bounded  set  in  X is  contained  in  a normal  set 
Note  that  A B is  also  normal. 

3.8  Pefn.  An  interval  in  K is  a subset  (a,b),  la,b),  (A,b)  or 
(n,bl  where  ••><  a ' b < °°. 

3.9  Defn.  - {s  | S is  a finite  union  of  disjoint  intervals 

R ~ 

in  k) 


3.10  Prop.  (H,  d,  Nr)  is  a normality  space  if  d(a,b)  = |a-b|. 

3.11  Pefn.  Let  f:  R * Y where  Y is  a narmality  space.  f is 

normal  iff 

a)  f (S)  is  bounded  if  S is  bounded  for  any  S R 

b)  Kor  any  normal  T t:  N , A c N^,  A /")  f 1 (T)  is  normal. 

Y K 

3 . Prop.  If  R ^ R X are  normal  functions  on  normality 

spaces  K,  X,  then  g f is  normal. 

Proof:  Prom  the  above  definition  part  a)  is  obviously  satisfied. 
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Let  A,  T be  as  in  part  b) . Since  A is  normal,  A is  bounded,  hence 
f (A)  is  bounded,  and  there  is  some  S c s.t.  f (A)  S.  Then 

A r\  f'1  (S  O,  g_1  (T)  ) = A^lf’1  g_1  (T)  and  A 0 f"1  g_1(T)  must 

be  normal  as  required.  ^ 

We  can  use  Prop.  3.12  to  define  a class  of  normal  thresholds 
which  are  guaranteed  to  take  normal  input  functions  to  normal  output 
functions.  Once  this  feature  is  guaranteed,  it  is  possible  to  define 
continuity  over  the  set  of  normal  functions,  which  will  be  done  in  the 
next  section. 

First,  suppose  X is  a finite  set  of  real  numbers.  Let  X also  be  a 
normality  space  by  taking  every  subset  open  and  normal;  let  0:  R + X be 
normal.  Then  the  normal  0 threshold  is  the  functional 

: PC(R+  , R)  -*  PC  ( R+ , X) 

where  SQ(f)  = 0*f 

By  Proposition  3.12  S~(f)  will  be  normal  if  f is:  thus  any  normal  0 

w 

threshold  will  have  the  desired  property. 

Proof : Immediate  from  Proposition  3.12. 

The  real  power  of  our  definitions  now  emerges  as  we  show  that  all 
normal  functions  can  be  represented  as  in  example  3.5. 

3.14  Defn.  Let  F be  the  set  of  all  normal  functions  from 

♦ R 'Y 
R to  normality  space  Y which  are  right-continuous. 


3.15  Proposition  Let  f f F ^ and  y C Y.  Then  PT  f (T  > 0)  takes 

~ R , Y 

on  the  value  y for  a finite  number  of  invervals. 

Proof:  Since  { y } is  normal,  so  is  10, T]  f (y). 

We  can  now  proceed  to  define  the  normal  inverse  of  a function  on  a 
rigorous  basis. 


3.16  Dofn.  Let  f e F . Let  T > 0 be  arbitrary. 

R -Y  T + 

1.  Define  for  fixed  T^f^:  Y R , i 1,  by 


T 

ci  (y) 


the  left  endpoint  of  the  ith  interval  in 
f_1(y)/r)[0,T]  if  there  is  an  ith  interval 


00  otherwise 

+ T 

2.  Define  f^y)  = 

3.  The  normal  inverse  of  f is  the  series  of  functions  {f^} 

i — I*  • 

3.17  Example  1.  Calculate  {sinNt)}  . It  can  be  checked  that 

sin(-)  is  normal  and  sin  c P . Figure  (2)  shows  graphically  the 

R , R 

normal  inverse.  It  can  be  seen  that 

sin+(t)  » » if  | t | > 1 

1 


and,  for  example, 


„in+(t)  - 2t>  * l~l  ♦ <-l>(i+1)  sin_1(t)  when  0 < t < 1 


Example  2.  1^'t.  sq:  R 

(Figure  3) . Then  sq  F F and 

R ,10,11 


t.  sq:  R+  * l0,l)  be  a square  wave  of  period  1 


p-Con t inui ty 

Armed  with  the  normal  inverse,  we  can  now  completely  formalize  the 
idea  of  Example  3.5. 

3.18  Defn.  Let  f,g  e FR  y. 

p(f,g)  « sup  | f ^ - g*|  where  is  taken  to  be  zero. 

3.18  Proposition;  p is  a metric. 

3. 20  Proposition:  Let  SQ  be  a threshold  as  in  Corollary  3.13.  Then 


I 
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S«  is  P-continuous. 

t; 

So  we  have  achieved  our  goal  of  defining  a notion  of  continuity 
which  includes  thresholds.  But  is  it  really  a useful  notion?  To  get 
a feel  for  p-continuity  we  discuss  briefly  some  of  its  properties. 

3 . 21  Proposition. 

1.  Let  d(f.g)  = / |f  - g|.  Then  lim  f = f if 

d 

1 jm  f ^ = f . 

2.  If  S , S are  p-continuous,  so  is 

p-continuity  also  seems  to  be  connected  to  circuit  realizability,  as  we  originally 
hoped.  The  following  examples  illustrate  some  p-continuous  coders  that 
are  realizable  with  the  configuration  on  Figure  (4):  a linear,  continuous 
filter,  thresholds,  and  a digital  computer  which  feeds  back  to  the  linear 
system. 

3.22  Example  p-continuous  coders 

1.  Zero  crossing  detection.  Let  D F ^ be  the  set  of  all 

R , {0, 1 } 

normal  continuous  functions.  The  zero-crossing  detector  flips  output 

whenever  the  input  crosses  through  zero.  Figure  5 that  a simple  threshold 
will  serve  as  realization. 

2.  Frequency  coder.  Note  that  every  F A is  Lesbegue  integrable, 

R , R 

since  the  inverse  of  any  half-open  interval  is  a finite  union  of  intervals. 


which  is  measurable.  So  we  can  define  a frequency  coder  as 


which  is  p-continuous.  As  an  idealized  element  with  which  this  coder 


could  be  realized,  we 


a two  input  system  which  integrates  the  first  input  and  resets  to  zero 


state  when  the  second  input  makes  a transition 


Co 


asxr»iv>e»v+ 


Oeco^f  < 


Corv»p*J  V<r 
C onWolIt*’ 
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